Ingénierie de la conception de systèmes de réalité augmentée mobile. Applications de la réalité augmentée mobile au tourisme culturel

Le système M.A.R. T.S a été conçu avec l'objectif de proposer un nouveau mode de médiation au musée. Lorsque la visite au musée se déroule sans guide conférencier, les outils de médiation classiques comme l'audio-guide ou les étiquettes montrent rapidement leurs limites en termes d'interaction humaine. Nous proposons donc de permettre au visiteur d'interagir avec un guide humain virtuel appuyé de nos paradigmes d'interaction " Sélection Documentation Reconstruction", puisant leurs principes de la réalité augmentée. L'objectif, par le biais de nos propositions, est de créer les conditions propices à un contact riche avec la collection, et de donner au visiteur les outils nécessaires pour qu'il puisse vivre une expérience d'apprentissage riche au musée. Les expérimentations que nous avons menées vont dans ce sens, montrant l'efficacité de ce nouveau mode de médiation. Qui plus est, les principes d'interactions sont suffisamment généraux pour dépasser le cadre original de la visite guidée au musée et peuvent être exploitée pour une visite guidée à l'extérieur.M.A.R.T.S system was built in order to propose a new mode of museum mediation. When the museum visit take place without a human guide, classical mediation tools such as labels or audio-guide rapidly show their limits in terms of human interaction. We therefore propose to allow visitors to interact with a virtual human guide supported by our interaction paradigms "Selection Documentation Reconstruction", which are based on augmented reality. The aim behind our proposals is to ensure favorable conditions for a rich contact with collections, and provide the visitor with necessary tools enabling him to live a worthwhile learning experience in the museum. The experiments we have conducted go in this direction, showing the effectiveness of this new mode of museum mediation. Moreover, interactions principles are sufficiently general to be applied to other cultural heritage activities such as outdoor guided tours

Coupling ground-level panoramas and aerial imagery for change detection

International audienceGeographic landscapes in all over the world may be subject to rapid changes induced, for instance, by urban, forest, and agricultural evolutions. Monitoring such kind of changes is usually achieved through remote sensing. However, obtaining regular and up-to-date aerial or satellite images is found to be a high costly process, thus preventing regular updating of land cover maps. Alternatively, in this paper, we propose a low-cost solution based on the use of ground-level geo-located landscape panoramic photos providing high spatial resolution information of the scene. Such photos can be acquired from various sources: digital cameras, smartphone, or even web repositories. Furthermore, since the acquisition is performed at the ground level, the users' immediate surroundings, as sensed by a camera device, can provide information at a very high level of precision, enabling to update the land cover type of the geographic area. In the described herein method, we propose to use inverse perspective mapping (inverse warping) to transform the geo-tagged ground-level 360 • photo onto a top-down view as if it had been acquired from a nadiral aerial view. Once re-projected, the warped photo is compared to a previously acquired remotely sensed image using standard techniques such as correlation. Wide differences in orientation, resolution, and geographical extent between the top-down view and the aerial image are addressed through specific processing steps (e.g. registration). Experiments on publicly available data-sets made of both ground-level photos and aerial images show promising results for updating land cover maps with mobile technologies. Finally, the proposed approach contributes to the crowdsourcing efforts in geo-information processing and mapping, providing hints on the evolution of a landscape. ARTICLE HISTOR

Active Learning based on the use of Augmented Reality Outline of Possible Applications: Serious Games, Scientific Experiments, Confronting Studies with Creation, Training for Carrying out Technical Skills

ISBN : 973-93-80868-64-1International audienceThis paper looks at augmented reality as a support for active learning. Fourth areas of application are studied: serious games, scientific experiments, confronting study results with creation and training for carrying out technical skills. After introducing a new proposed augmented reality definition, we illustrate each area with original examples like an augmented reality serious game to understand electromagnetic phenomena and their applications in electrical engineering or still an augmented reality training application to learn welding. At the end, we finish to observe that systems using augmented reality can provide a semi-determinist aspect where technology is easier to implement, less rigid and more interactive than other traditional systems

Mobile Augmented Reality: Applications and Spe-cific Technical Issues

DOI: 10.1007/978-3-319-04702-7 Print ISBN: 978-3-319-04701-0 Online ISBN: 978-3-319-04702-7Although human's sedentary nature over time, his wish to travel the world remains as strong as ever. This paper discusses how imagery and Augmented Reality (AR) techniques can be of great help not only when discovering a new urban environment but also when observ-ing the evolution of the natural environment. The study is applied on Smartphone which is currently our most familiar device. Smart phone is utilized in our daily lives because it is low weight, ease of communications, and other valuable applications. In this chapter, we discuss technical issues of augmented reality especially with building recognition. Our building recog-nition method is based on an efficient hybrid approach, which combines the potentials of Speeded Up Robust Features (SURF) features points and lines. Our method relies on Approxi-mate Nearest Neighbors Search approach (ANNS). Although ANNS approaches are high speed, they are less accurate than linear algorithms. To assure an optimal trade-off between speed and accuracy, the proposed method performs a filtering step on the top of the ANNS. Finally, our method calls Hausdorff measure [15] with line models

MARTS : Conception d'un Système Mobile de Réalité Augmentée Dédié au Tourisme

National audienceLe but de cet article est de montrer comment les interfaces mobiles et la Réalité Augmentée (RA)peuvent s'avérer être une assistance précieuse à la navigation piétonne. Le support de l' étude est tout naturellement le Smartphone qui est devenu en quelques ann'ees l'appareil qui nous est le plus familier, qui nous accompagne quotidiennement partout ou nous nous déplaçons. Après avoir examiné les différentes situations auxquelles peut être confronté un touriste qui visite un environnement urbain pour la première fois, nous proposons le concept d'un nouveau système multimodal, le système MARTS, d'aide à la navigation piétonne que nous prévoyons réaliser

Adaptive Augmented Reality: Plasticity of Augmentations

International audienceAn augmented reality system is used to complete the real world with virtual objects (computer generated) so they seem to coexist in the same space as the real world. The concept of plasticity [4][5] was first introduced for Human Computer Interaction (HCI). It denotes the ability of an HCI interface to fit the context of use defined by the user, the environment and the platform. We believe that plasticity is a very important notion in the domain of augmented reality. Therefore, we rely on it in order to introduce the concept of adaptive augmented reality. This concept is based on the triplet (user, environment and platform) constituting the context of use. Adaptive augmented reality can foster functional ability, ease of use and portability of new augmented reality applications. Thus, we describe in this paper three applications showing the adaptation of augmentation based on three variables: the scene illumination, the distance to the target and the ambient noise

Mobile Augmented Reality Applications to Discover New Environments

International audiencealthough man has become sedentary over time, his wish to travel the world remains as strong as ever. The aim of this paper is to show how techniques based on imagery and Augmented Reality (AR) can prove to be of great help when discovering a new urban environment and observing the evolution of the natural environment. The study's support is naturally the Smartphone which in just a few years has become our most familiar device, which we take with us practically everywhere we go in our daily lives

Une nouvelle interface avec le monde : Les guides virtuels.

National audienceS'il est vrai que l'homme est devenu sédentaire au cours des ages, son aspiration à parcourir le monde est toujours aussi forte. Le tourisme est ainsi devenu la principale source de revenus de nombreux pays ; les revenus lies à ce secteur sont fortement excédentaires en France et 'a la base de l'économie de plusieurs de nos régions. A l'aube de l'informatique nomade, nous proposons une nouvelle interface avec le monde : l'homme découvre le monde accompagne de guides virtuels. Deux illustrations sont principalement proposées dans ce papier qui sont, d'une part, la découverte et l'observation de la terre et, d'autre part, la découverte l'héritage culturel et historique d'une ville

Partage de données environnementales pour la découverte et l'observation de la terre

National audienceLe but de cet article est de montrer comment les techniques basés sur l'image et la réalité augmentée (RA) peuvent s'avérer être une aide précieuse à la découverte de la terre et l'observation de l''évolution de l'environnement. Le support de l' étude est tout naturellement le Smartphone qui est devenu en quelques années l'appareil qui nous est le plus familier, qui nous accompagne quotidiennement partout ou nous nous déplaçons

Haptic System for Eyes Free and Hands Free Pedestrian Navigation

International audienceUntil now, Augmented Reality was mainly associated with visual augmentation which was often reduced to superimposing a virtual object on to a real world. We present in this document a vibro-tactile system called HaptiNav, which illustrates the concept of Haptic Augmented Reality. We use the haptic feedback method to send users information about their direction, thus enabling them to reach their destination. To do so, we use a turn by turn metaphor which consists of dividing the route into many reference points. In order to assess the performances of the HaptiNav system, we carry out an experimental study in which we compare it to both Google Maps Audio and Pocket Navigator systems. The results show that there is no significant difference between HaptiNav and Google Maps Audio in terms of performance, physical load and time. However, statistical analysis of the mental load, frustration and effort highlights the advantages of HaptiNav compared to two other systems. In the light of the results obtained, we present possible improvements for HaptiNav and describe its second prototype, at the end of this paper